Nonequilibrium entropy production for open quantum systems 
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We consider open quantum systems weakly coupled to a heat reservoir and driven by arbitrary 
time-dependent parameters. We derive exact microscopic expressions for the nonequilibrium en- 
tropy production and entropy production rate, valid arbitrarily far from equilibrium. By using the 
two-point energy measurement statistics for system and reservoir, we further obtain a quantum 
generalization of the integrated fluctuation theorem put forward by Seifert [PRL 95, 040602 (2005)]. 
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Nonequilibrium phenomena are ubiquitous in nature. 
Yet, a general framework allowing their description far 
from equilibrium is lacking pQ . A denning feature of out- 
of-equilibrium systems is that they dissipate energy in the 
form of heat, leading to an irreversible increase of their 
entropy The nonequilibrium entropy production £ and 
its time derivative, the entropy production rate tr = <9 t £, 
are therefore two fundamental concepts of nonequilib- 
rium thermodynamics [T] . Traditionally, the entropy pro- 
duction is used to evaluate the performance of thermody- 
namic devices: the maximal useful work, the availability 
(or exergy), that can be extracted from a given system, 
is reduced by the presence of irreversibilities, such as fric- 
tion or nonstatic transformations. This loss of availabil- 
ity is directly related to the mean entropy production 
(S) [2] . On the other hand, the entropy production rate 
is the generating function of the nonequilibrium fluxes. 
Consider a system driven away from equilibrium by some 
thermodynamic forces Xi, for example an electric field 
or a temperature difference. These forces will cause un- 
known nonequilibrium fluxes J;, for instance an electric 
current or a heat flow, that are given by the derivative of 
the entropy production rate with respect to the applied 
force, Ji = da/dXi pj]. More recently, the entropy pro- 
duction has been instrumental in the analysis of nonequi- 
librium effects in many different branches of physics [4]- 
[6], including the study of quantum impurity models [7] 
and of quenched quantum many-body systems [8J. The 
explicit expression of the mean quantum entropy produc- 
tion (£) is in general unknown, however. A remarkable 
property of the entropy production is that it satisfies a 
fluctuation theorem of the form (exp(— £)) = 1, which 
holds arbitrarily far from equilibrium [5] 110) . A uni- 
fied version of classical fluctuation theorems, valid for 
nonequilibrium initial conditions and arbitrary driving, 
has lately been obtained by Seifert for the total entropy 
change occurring in system and reservoir . 

In this paper, we provide generic microscopic expres- 
sions for the entropy production, and the entropy pro- 
duction rate, for open quantum systems that are weakly 
coupled to a heat reservoir and driven arbitrarily far from 
equilibrium by external parameters. The time evolution 
and the thermodynamic properties of weakly damped 



quantum systems are usually described by Markovian 
master equations of the Lindblad type [T2lU4| . With 
their help, microscopic expressions for the entropy pro- 
duction rate in terms of the reduced density operator 
of the system have been obtained for relaxation |15) . 
transport |16j and slowly driven quantum processes |17j . 
Moreover, a fluctuation theorem for the entropy pro- 
duced along quantum trajectories has been derived in 
Refs. 18 20J . However, Markovian master equations are 
limited to slow driving, that is near equilibrium pro- 
cesses, as their derivation is based on the assumption 
of time- independent Hamiltonians [21] . A formulation of 
completely positive maps for fast driven quantum sys- 
tems, that is far from equilibrium transformations, for 
which the Markovian approximation is likely to break 
down, appears difficult [22], [23]. In the following, we 
employ a thermodynamic approach to derive the exact 
mean nonequilibrium quantum entropy production and 
mean quantum entropy production rate without relying 
on master equations or on quantum trajectories. The 
obtained expressions are therefore valid for driving pro- 
cesses that operate arbitrarily far from equilibrium. In 
addition, starting from the two-point energy measure- 
ment statistics for system and reservoir, we derive a quan- 
tum extension of Seifert 's fluctuation theorem [11] . Our 
general formalism allows us to recover and extend a num- 
ber of previously known results in a unified manner. 

Nonequilibrium quantum entropy production. We con- 
sider a quantum system whose Hamiltonian H t is driven 
by an arbitrary time-dependent external parameter dur- 
ing a finite time interval r. The system is assumed to be 
weakly coupled to an infinitely large thermal reservoir 
with which it can exchange energy in the form of heat 
[24] , We focus for the time being on the situation where 
the system is initially and finally in an equilibrium (or 
at least local equilibrium) state, so that its thermody- 
namic variables — in particular its entropy — are well de- 
fined. We emphasize that the quantum system need not 
be in equilibrium with the reservoir at these times (it can 
for instance be at another temperature) , nor does it need 
to remain close to equilibrium during the driving process 
(see Fig. 1). We denote by AU = U T — Uo the change 
of internal energy between final and initial states and by 
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AS = S t — Sq the corresponding change of entropy. Since 
U and S are state functions, their variations are process 
independent. According to the laws of thermodynamics, 
the changes of internal energy and entropy are pQ 



AU = (W) + (Q) , 
AS = /3<Q} + <£) 



(1) 

(2) 



where (W) is the mean work done on the system, (Q) 
the mean heat exchanged during the process, and (£) 
the mean entropy production (/? = 1/T is the inverse 
temperature of the reservoir). It is worth noticing that 
these quantities are well-defined for arbitrary nonequilib- 
rium transformations. In particular, the thermodynamic 
entropy may not be defined out of equilibrium, but the 
entropy production between initial and final equilibrium 
states always is. From Eqs. (1) and (2) we see that the 
mean noncquilibrium entropy production is given by, 



(£) = AS - I3AU + 13 (W) . 



(3) 



In order to obtain a microscopic expression for (S), we 
introduce the reduced density operator p t of the sys- 
tem. The initial and final equilibrium operators are pi = 
exp(— /3iHo)/Zi and pf = exj}(—/3fH T )/Zf, where Zi and 
Zf arc the partition functions. Wc further define the in- 
stantaneous equilibrium operator p° q = exp(—/3Ht)/Zt, 
with respect to the reservoir, that corresponds to the 
Hamiltonian H t . The initial entropy is then of the form, 



-tr {pi In p^ 



(4) 



At the same time, the initial internal energy is, 

m = /3tr { Pi H } = -tr { Pl In p cq } + In Z Q , (5) 

where we have used Zq = tr {exp (— /3Hq)}. Similar ex- 
pressions are obtained for the final entropy and inter- 
nal energy by replacing i by / and by r. We identify 
the mean work done during the process with the average 
change of the Hamilton with time [T2"] . 



p(W)=/3 dttv{p t d t H t } 

r (6) 

= dtti {p t dt In p'p} — In Z T + In Zq . 

Jo 

Combining Eqs. we obtain the general expression, 

(£) =S(pi\ |p c q ) - S ( Pf \\p c T q ) - f dt tr {p t d t In p cq } , 

Jo 

(7) 

where we have introduced the quantum relative entropy 
of two operators S (pi||pa) = tr {pi In p\ — p\ In P2} [25] , 
Equation Q is the exact microscopic expression for the 
mean noncquilibrium entropy production for a driven 
open quantum system weakly coupled to a single heat 
reservoir. It is valid for intermediate states that can be 
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FIG. 1: During a quasistatic process, a weakly damped sys- 
tem remains in equilibrium with the reservoir at all times. 
We here consider open quantum systems that are driven by 
arbitrary time-dependent external parameters and may ini- 
tially and finally be in any state pi and pf, not necessarily in 
equilibrium with the reservoir. 



arbitrarily far from equilibrium. We next focus on four 
special cases to elucidate the physical meaning of the dif- 
ferent terms appearing in Eq. ([7]), 

a. Let us start with the case of an undriven system, 
dtH t = 0, which corresponds to a pure relaxation process 
(without work). Since P f — p° q , Eq. ^ reduces to 



/ cquil. 



= S (pi\\Po 



eq \ 



(8) 



This is the mean entropy production associated with the 
equilibration of the quantum system with the reservoir, 
a result first obtained by Schlogl for classical noncquilib- 
rium systems [26] (see also Refs. [27l [28]). 

b. Assume the system is initially in equilibrium with 
the reservoir, pi — p*^ (no initial equilibration). When 
the driving is such that the system also ends in equilib- 
rium with the reservoir at t — r, p T = p° q = P f — the sit- 
uation usually considered in thermodynamics [5] — then 



/ dttr {p t d t In p e t q } 
Jo 



(9) 



Since initial and final temperatures are the same, the 
mean quantum entropy production is here simply given 
by the irreversible work divided by the temperature, 



(S) = p((W) - AF) = pw h 



(10) 



with AF = AU - TAS when T = constant. 

c. On the other hand, for general driving, the system 
will be not be in equilibrium with the reservoir at the 
end of the driving protocol, p/ 7^ p£ q , and an additional 
relaxation process will hence take place. As a result, 



/ driving+equil. 



-S(p f \\p<?)- r dttr{p t d t \n P cq } . 
Jo 

(11) 

We can therefore conclude that the general form of the 
entropy production Q accounts for all three kinds of ir- 
reversibilities that can occur in the driven open quantum 
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system: initial relaxation, far from equilibrium driving 
and incomplete final relaxation. Equation ^ thus ex- 
presses the additivity of the entropy production. 

d. For closed, initially thermal quantum systems, 
the dynamics is unitary (without heat exchange) and 
<9 t tr{p t lnp t } = 0. The entropy production is thus [25] . 



/ dt tr {p t d t In pf} 
Jo 



(12) 

dt8tS(pt\\p?) = S(p T \\p'?) = PW iI , 



where the second line follows from the unitary evolution, 
as given by the von Neumann equation p t = —i[H t ,pt] 



equilibrium state E n and E R . The latter can be de- 
termined simultaneously since the Hamiltonians of the 
system and of the reservoir commute. In the limit of 
weak coupling, the system-reservoir interaction energy 
may be neglected. For a single realization of the pro- 
cess, the heat exchanged by the system is thus given by 
the energy variation of the reservoir Q = — (E R — Ejf). 
We further introduce the energy change in the system, 
weighted by the different initial and final inverse temper- 
atures, AEp f! p. = PfE n — PiE m . The joint probability 
distribution P[AE^.p i , j3Q) is then 

V (AE^^pQ) = 6 ( AE PfA ~ (Pf E n ~ PiE m )) 



Equation (fT2l) provides a good approximation when the X 5 (/3Q + f}{E^ - E^)) p(n, u\m, p)p 



m.fi 



driving rate is much larger than the relaxation rate of the 
system and the coupling to the reservoir can be neglected. 



A classical version of Eq. (12 1 can be found in Ref. 



(see also Ref. [3T]). We note that for classical open sys- 
tems the total mean nonequilibrium entropy production 
is given by the classical counterpart of Eq. Q. 

Nonequilibrium entropy production rate. The instan- 
taneous entropy production rate is defined as the time 
derivative of the nonequilibrium entropy production, a = 
dtT, pp. As discussed in the introduction, it contains es- 
sential information about the nonequilibrium dynamics 
of a system. Taking the derivative of Eq. |7| , we obtain, 



°~ = —dtS (pt \\pt q ) — tr {p t dt In p^ q } , 
= -tr{(d tPt ) hi + tv{(d tPt ) lnp* q } 



(13) 



The above expression agrees with the entropy produc- 
tion rate for slowly driven open quantum systems de- 
rived by Breuer using a Markovian master equation of 
the Lindblad type [T7J (see also Ref. [13]). In the limit 
of undriven quantum systems, it reduces to the result 
a = —d t S (/Ot||po q ) previously derived by Spohn [15]. We 



emphasize that Eq. ( 13 1 is valid far from equilibrium. 



Quantum fluctuation theorem. One can broadly distin- 
guish two strategies for deriving quantum fluctuation the- 
orems. In the first approach, thermodynamic variables, 
like work, heat and entropy, are defined along single tra- 
jectories of the system [I8ll20j . In the second approach, 
work and heat are determined by two energy measure- 
ments, one taking place before and the other one after the 
time-dependent driving [3"2Tf3"B"] . We note, however, that 
the question of how to experimentally determine ther- 
modynamic quantities along quantum trajectories is still 
unsolved, contrary to the case of energy measurements, 
for which a non-demolition scheme has been proposed in 
Ref. [37]. We will therefore follow the second approach. 

We denote by E m and Ej? the respective eigenvalues 
of system and reservoir obtained after a joint measure- 
ment of their energies in the initial state before the driv- 
ing. Similarly, we call the corresponding energy eigen- 
values obtained after a joint measurement in the final 



(14) 

where p(n, v\m, p) is the total transition probability for 
system and reservoir to evolve from the state (m, p) to 
the state (n, v), and p m ^ = exp(-/3iE m - /3E R ) /{ZiZ R ) 
is the initial occupation probability. Equation ( 14 ) is 



a two-tcmpcrature generalization of the joint probability 
distribution for internal energy change and heat discussed 
in Refs. [35] [36]. We next define the entropy variation 
that occurs in the system during a single realization of 
the driving protocol as, 



where Fj 



AS = (3 f (E m - Ff) - pi{E n - F t ) 
= AE 0f!0i - l3 f F f + faFi , 

= -(l/PijlnZi and F 



(15) 



/ 



{l/Pf)h\Zf are 
the free energies of the system in the initial and the fi- 
nal states. Since In Zi = — hip™ — /3iE m and In Zf = 
— InpJ — PfE n , with p m and p^ the initial and final oc- 
cupation probabilities of the system, we have, 

6{AEp f!f)i - (f3 f E n - fcE m )) = 5{AS + \np n f - Inp?) . 

(16) 



The change of variable AEp , ^. — > AS in Eq. ( 14 ) then 
yields the joint distribution for entropy and heat, 

V{AS,pQ)= 6(AS + \np n f ~lnp?) 

x6(j3Q + /3(E?-E*)) p(n,v\m,p)p mtfi . (17) 

According to Eq. (2) the nonequilibrium entropy produc- 
tion for a single realization is 



E = AS - 0Q 



(18) 



The entropy production S is thus the sum of the entropy 
variation of the system AS and of the reservoir AS R = 
—/3Q, and hence corresponds to the total entropy change. 
The distribution of the entropy production is obtained by 
integrating Eq. p7[) over the heat. We find, 



P(E) = J d{PQ)V{PQ + V,f5Q) 

= ]T 5{Y> + \np<}-\np?-P{EK-E*)) 

xp(n,v\m,p)p m , ll . (19) 
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One can verify that the mean quantum nonequilibrium 
entropy production (£) computed directly from Eq. ( 19 ) 
leads to the general expression Q, as it should. To finally 
establish the quantum fluctuation theorem, we evaluate, 

(exp (-£)) = J d£ exp (-S)-p(S) 

= X] P( n > v \ m ^)Pn,v = 1 , (20) 

with p n}V = cxp(-(3 f E n - /3E^')/(Z f Z R ). Here, we 
have used that the reservoir remains in equilibrium at all 
times. The last equality follows from the unitary dynam- 
ics of system-plus-reservoir and the normalization of the 
corresponding total density operator. Equation (20) is 



valid for any initial equilibrium condition of the quantum 
system — not necessarily equilibrium with the reservoir. 

So far, we have restricted ourselves to initial and final 
equilibrium states for which the thermodynamic entropy 
is well-defined. However, by twice measuring the density 
operator of the system, instead of its Hamiltonian, and 
obtaining the two states \r) and \s), we can introduce the 
information entropy production for a single realization, 

X T = -ln{s\p f \s) +la{r\p i \r} - p(E? - E*) . (21) 

After averaging, the first two terms on the right-hand 
side become the von Neumann (information) entropy of 
final and initial states. An analogous derivation then 
shows that the quantity £j satisfies a fluctuation theo- 
rem, (exp(— £/)) = 1, that is valid for any initial and final 
nonequilibrium states. The latter is the quantum gener- 
alization of the integral fluctuation theorem proposed by 
Seifert |llj . The corresponding mean information en- 
tropy production is given by Eq. |7]) with arbitrary p t 
and pf. In particular, for an undriven partial relaxation 
process from a nonequilibrium state to another, we have, 



(E I )=S( Pi \\p?)-S(p f \\p?) 



(22) 



which is consistent with the result obtained in Ref. [55] . 
in the limit of weak system-reservoir coupling. 

Conclusion. We have developed a generic formal- 
ism which allows the determination of the exact mean 
nonequilibrium entropy production, and entropy produc- 
tion rate, for open quantum systems driven arbitrar- 
ily far from equilibrium. Moreover, by using a joint 
system-reservoir-measurement approach, we have derived 
a quantum extension of the integral fluctuation theorem 
of Seifert for the total entropy change. 

This work was supported by the Emmy Noether Pro- 
gram of the DFG (contract No LU1382/1-1) and the clus- 
ter of excellence Nanosystems Initiative Munich (NIM). 
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